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Abstract 

The dual reduction process, introduced by Myerson, allows to reduce a 
finite game into a smaller dimensional game such that any equilibrium of the 
reduced game is an equilibrium of the original game. This holds both for Nash 
equilibrium and correlated equilibrium. We present examples of applications 
of dual reduction and argue that this is a useful tool to study Nash equilibria 
and correlated equilibria. We then investigate its properties. 
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1 Introduction 



Dual reduction is a reduction process for finite games defined by Roger Myer- 
son (f997), which generahzes ehmination of dominated strategies. It takes its 
roots in the proofs of existence of correlated equilibria of Hart and Schmeidler 
(1989) and Nau and McCardle (1990). Dual reduction's main property is that 
any Nash or correlated equilibrium of the reduced game is an equilibrium of 
the original game. Moreover, by iterative dual reduction, any finite game may 
be reduced to an elementary game; that is, to a game in which all incentive 
constraints defining correlated equilibria can be satisfied as strict inequalities 
in a correlated equilibrium. Myerson (1997) also showed that, while some 
games may be reduced in several ways, this ambiguity is alleviated if we focus 
on a specific class of dual reductions, called full dual reductions. 

The aim of this article is to show that dual reduction is a powerful tool to 
study Nash equilibria and correlated equilibria, and to study its properties. 
It is organized as follows: in the next section, we recall the basics of dual 
reduction. Section [3] gives examples of applications of dual reduction: we first 
give an elementary proof of the fact that a unique correlated equilibrium is a 
Nash equilibrium. The proof is elementary in that it relies entirely on linear 
programming. We then show that dual reduction allows to prove the existence 
of Nash equilibria with special properties and to study the geometry of the 
set of correlated equilibria. In section [H the properties of dual reduction are 
investigated. For instance, we show that rescaling the payoffs does not change 
the ways in which a game may be reduced; that in all full dual reductions, 
all strategies that have probability zero in all correlated equilibria are elimi- 
nated ; and that any zero-sum game and any game with a unique correlated 
equilibrium is reduced by all full dual reductions into a game with a unique 
pure strategy profile. We also show that, in almost all two-player games, the 
iterative reduction process is uniquely defined, as long as we focus on full dual 
reductions. Finally, a proof is given in the appendix. Unless stated otherwise, 
all references to Myerson are to Myerson (1997). 

Notations. As Myerson, we denote a finite game in strategic form by 

r = {N, {Ci)i^N,{Ui)i^N) 

where N is the set of players, Ci the set of pure strategies of player i, and Ui : 
Xji^nCj — > M the utility function of player i. The set of pure strategy profiles 
is denoted by C = Xj^j^Cj. For each player i, we let C-i = ^jeN\{i}Cj- If 
c = {cj)j^N is a pure strategy profile and di a pure strategy of player i, we let 
{c-i,di) denote the pure strategy profile that differs from c only in that the 
z-component is di. 

For any finite set S, we let |5| denote its cardinal and A(S') the set of 
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probability distributions over S. A correlated strategy of the players in N is 
an element of A(C). Thus, /U = (^(c))c6C is a correlated strategy if and only 
if /x(c) > for any c in C and X^^eC = 1- 

Let /X be a correlated strategy. Assume that before play, a mediator draws 
a pure strategy profile c with probability /x(c) and then privately recommends 
Cj to player i, for every i in N. The correlated strategy is a correlated 
equilibrium (Aumann, 1974, 1987) if no player has an incentive to deviate 
unilaterally from these recommendations. That is, is a correlated equilib- 
rium if and only if it satisfies the following incentive constraints: 

J2 Kc) [Ui{c-i, di) - Ui{c)] < G AT, Vci G Q, Vd^ G d (1) 

For every i in A^, we let Cf C Ci denote the set of pure strategics of player i 
which have positive marginal probability in at least one correlated equilibrium. 

For any mapping : Cj ^ A(Ci) and any Cj, in Cj, wc may write Oj * Cj 
instead of aj(cj) to denote the image of Cj by this mapping, and ai{di\ci) 
instead of (a^ * Cj)(dj) to denote the probability of di in the mixed strategy 
aj * Cj. This is for consistency with Myerson. 

2 Basics of dual reduction 

Unless stated otherwise, all results of this section are due to Myerson. 

Dual vectors. Assume that before play a mediator privately recom- 
mends a pure strategy to each player, who can either obey or deviate from 
this recommendation. The behavior of player i can then be described by a 
mapping Ui : Cj — > A(Cj), which associates to every pure strategy q the ran- 
domized strategy Oj * q that she will play if recommended q. The mapping 
ai may be called a deviation plan for player i. If a mediator tries to imple- 
ment a pure strategy profile c, then player i's gain from deviating unilaterally 
according to ccj instead of following the mediator's recommendation is 

Di{c,ai) := Ui{c-i,ai * Ci) - Ui{c) 

Let a = (Q;j)j£7v be a profile of deviation plans and let -D(c, a) denote the sum 
of the above gains over the set of players: 

D{c, a) := ^ Di{c, ai) = ^ [C/j(c_j, * Cj) - Ui{c)] 

ieN ieN 

Definition. A dual vector is a profile of deviation plans a = {ai)i^N such 
that £)(c, a) > for every pure strategy profile c in C. 
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Dual vectors arise from the linear programming proofs of existence of cor- 
related equilibria (Hart and Schmeidler, 1989; Nau and McCardle, 1990). Any 
game has at least one dual vector. Indeed, letting a, * q = Cj for all i in N 
and all Cj in Cj defines a dua] vector. We caJl the tn»„i iual «ector^ 

How to reduce a game using a dual vector. Let a be a dual 
vector. The mapping : Cj ^ A(Cj) induces a Markov chain on Cj. This 
Markov chain partitions Ci into a set of transient states and disjoint minimal 
absorbing setso Let us say that a mixed strategy cTj of player i is ai-stationary 
if * (Tj = (Ti, where 



From the basic theory of Markov chains, it follows that for every minimal 
absorbing set Bi C Ci, there is a unique aj-stationary mixed stategy with 
support in B^. Let Ci/ai denote the set of such Oj-stationary strategies with 
support in a minimal absorbing set. The a-reduced game, denoted by L/a, 
is the game with the same set of players and the same utility functions as in 
r, but in which, for every i in N , the pure strategy set of player i is Ci/ai: 



The reduction thus operates by eliminating some strategies and grouping other 
strategies together. 

More precisely, if q G Cj is a transient state for the Markov chain in- 
duced by Oj, then q is eliminated. That is, (Ji{ci) = for all cjj in Ci/ui. 
If Ci is aj-stationary (i.e. aj * Cj = Cj), then Cj is kept as a pure strat- 
egy: Ci G Ci/ai. Finally, if Cj is neither transient nor stationary, then Cj 
is grouped with the other strategies of its minimal absorbing set, so that: 
3(Ji G Ci/ai,ai ^ Ci and ai{ci) > 0. 



^To see how dual vectors arise from the proofs of existence of correlated equilibria, consider 
the auxiliary zero-sum game in which the maximizer chooses a pure strategy profile c of F, the 
minimizer a profile of deviation plans a — {ai)iizN, and the payoff is —D{c,a). In this game (a 
variant of Hart and Schmeidler's (1989) auxiliary game), a randomized strategy of the maximizer is 
a correlated strategy of F, and it guarantees a payoff of if and only if it is a correlated equilibrium. 
Thus, to prove existence of correlated equilibria, it suffices to show that the value of the auxiliary 
game is at least 0. In fact, it is exactly because the minimizer can guarantee by choosing the 
trivial deviation vector. It follows that dual vectors may be defined as the optimal strategies of 
the minimizer in this auxiliary game. Similarly, Myerson introduces dual vectors as the optimal 
solutions of the dual of a linear program whose optimal solutions are the correlated equilibria. 

nonempty subset Bi of Ci is a minimal absorbing set if : (i) for every Ci in Bi, ai * Ci has 
support in Bi and (ii) it contains no nonempty proper subset satisfying (i). 




T/a = {N, {C,/ai),^N, {Ui)i^N} 
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Definition. A dual reduction of T is any a-reduced game T/a where a is a 
dual vector. An iterative dual reduction of T is any game T jaxja^l ■ ■ ■ where 
each a'^ is a dual vector for T/a^ /a"^ / . . . /a^~^. (The expression "dual reduc- 
tion" may refer either to a reduced game or to the reduction technique.) 

Let C/a = Xi^j^Ci/ui denote the set of pure strategy profiles of the 
reduced game T/a. So the set of correlated strategies of the reduced game 
is A(C/a). Any correlated strategy fj, in C/a can be mapped back to a 
F-equivalent correlated strategy fl in the natural way: 

o-GC/a 

(the mapping ^ p, may be shown to be injective). Myerson's main result 
is that if /i is a correlated equilibrium of a dual reduction of F, then /i is a 
correlated equilibrium of T. The same result holds for Nash equilibrium. 

The main step of the proof is to show that, if u is a mixed strategy profile 
such that, for every j ^ i, aj is Oj-stationary, then Ui{a) < Ui{a-i,ai * fjj). 
The derivation of this fact will be used in sections [3] and H] and so we recall it: 
for every j in A^, 

^ a{c)Dj{c, aj) = Uj{a-j,aj * aj) - Uj{a) 

Indeed, both sides of the equation represent the expected gain for player j 
from deviating according to aj, when all other players obey a mediator who 
is trying to implement a. Summing over the set of players N, we get 

^^7(c)Z)(c,a) = Pj{'^-j,aj*^j) - Uj{a)] (2) 

cGC jeN 

If aj * aj = cTj for all j ^ i, then ([2]) boils down to 

Y <^{c)D{c, a) = Ui{a-i,ai * ai) - Ui{a) (3) 

cec 

Since a is a dual vector, D{c, a) > for all c, hence the left hand side of ([3]) 
is nonnegative. Thus, ([3]) =^ Ui{a) < Ui{a-i,ai * ai). 

Jeopardization and reduction to elementary games A game is el- 
ementary (Myerson) if it has a correlated equilibrium fi which satisfies all 
incentive constraints with strict inequality: 

Y m(c) [U^{c.^, di) - Ui{c)] > Vi € A, Vq / di (4) 

CGC 

If /i satisfies (j4]), then for any correlated strategy /i' with full support and 
for any e small enough, (1 — e)/i + e^' is a strict correlated equilibrium with 
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full support; conversely, any strict correlated equilibrium with full support 
satisfies So, elementary games can also be defined as those games having 
a strict correlated equilibrium with full support I§ 

Myerson shows that a game may be strictly reduced if and only if it is not 
elementary; this implies that, though many games are not elementary (e.g., 
Matching Pennies), any game may be reduced to an elementary game by it- 
erative dual reduction. The proof is based on the concept of jeopardization 
and proposition [T] below: a strong complementary slackness property which 
we will use extensively. 

Definition. Let Cj and di be pure strategies of player i. The strategy di 
jeopardizes Ci if, in every correlated equilibrium fi, the incentive constraint 
stipulating that player i should not gain by deviating from Cj to di is tight. 
That is, 

Kc)[Ui{c-„di)-U,{c)]=0 

C—i^C—i 

Proposition 1. There exists a dual vector a such that ai{di\ci) > if and 
only if di jeopardizes Ci . 

Full dual reduction Let us say that a dual vector is full (or has full 
support) if it is positive in every component that is positive in at least one dual 
vector. By proposition [H for any full dual vector a and any pure strategies 
Ci and di in Cj, ai{di\ci) > if and only if di jeopardizes Cj. Existence of full 
dual vectors follows from the convexity of the set of dual vectors. A full dual 
reduction of V is any reduced game T /a where a is a full dual vector. 

The interest of full dual reductions is not only that there are less full 
dual reductions than dual reductions. It also lies in the following properties, 
which remain implicit in Myerson: any full dual vectors, having the same 
positive components, induce the same minimal absorbing sets. Therefore, in 
any full dual reduction, the pure strategies which are eliminated (resp. kept 
as pure strategies, grouped together) are the same. Moreover, in any full dual 
reduction, there are weakly less pure strategies remaining than in any other 
dual reduction of the same game. That is, if a is a full dual vector and (3 
is any dual vector, then \Ci/ai\ < \Ci/l3i\. This follows from the fact that 
any component that is positive in /3j is also positive in Oj, and from basic 
properties of Markov chains. 

■^A correlated equilibrium /i has full support if /i(c) > for all c in C . It is strict if the incentive 
constraint ([1]) is satisfied with strict inequality, for any i in N , any Ci with positive marginal 
probability in and any di ^ Ci. 
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3 Some applications of dual reduction 



This section aims at showing, by way of examples, that dual reduction is a 
useful tool to study properties of Nash equilibria and correlated equilibria. 

A unique correlated equilibrium is a Nash equilibrium: an elemen- 
tary proof Consider first the fact that, if a game has a unique correlated 
equilibrium, then this correlated equilibrium is a Nash equilibrium. Of course, 
as existence of correlated equilibria, this follows from the existence of Nash 
equilibria and the fact that any Nash equilibrium is a correlated equilibrium. 
But, as for existence of correlated equilibria (Hart and Schmeidler, 1989; Nau 
and McCardle, 1990), it would be nice to find a more direct proof, relying 
solely on linear programming. Dual reduction provides such a proof. 

Indeed, let F be a game with a unique correlated equilibrium. By iterative 
dual reduction, T may be reduced to an elementary game T^. Since is ele- 
mentary (i.e. has a strict correlated equilibrium with full support), it follows 
that either has an infinity of correlated equilibria, or has a unique strat- 
egy profile. Since T has a unique correlated equilibrium and since different 
correlated equilibria of induce different correlated equilibria of T, the first 
case is ruled out. Therefore, has a unique strategy profile, hence trivially 
a Nash equilibrium. This implies that T has a Nash equilibrium hence that 
the unique correlated equilibrium of F is a Nash equilibrium. 

This proof relies on: a) the definition of dual reduction, which requires the 
Minimax theorem and existence of stationary distributions for finite Markov 
chains; and b) the fact that any game may be reduced to an elementary game, 
which Myerson proved through the strong complementary property of linear 
programs. Since the existence of stationary distributions for finite Markov 
chains can be deduced from the Minimax theorem, the above proof relies 
solely on linear duality. In particular no fixed point theorem is used0 

Equilibria with special properties. Dual reduction also allows us to 
prove existence of equilibria with special properties. For instance: 

Proposition 2. In any finite game, there exists a Nash equilibrium a such 
that, for every player i and every pure strategy Ci with marginal probability 
zero in all correlated equilibria, Ci is not a best response to a^i. 

*The fact that the existence of stationary distributions for finite Markov chains can be deduced 
from the Minimax theorem is mentioned by Mertens et al (1994, ex. 9, p. 41). To see this, let 
M = (mij) denote a stochastic matrix (that is, the are nonnegative and each columns sums 
to unity). Applying the lemma of Hart and Schmeidler (1989, p. 19) with ajk = mkj and u a 
basis vector, we get that there exists a probability vector x such that Mx — x. Since Hart and 
Schmeidler prove this lemma via the Minimax theorem, this shows that existence of stationary 
distributions for finite Markov chains can indeed be deduced from the Minimax theorem. 
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We first need to introduce a new class of dual vectors. 

Definition. A dual vector is strong if for every pure strategy profile c in C 
with probability zero in all correlated equilibria, 

D{c,a) = ^[Ui{c-i,ai*Ci)-U^{c)] >0 
ieN 

(the first equality simply recalls the definition of D{c, a)). Existence of strong 
dual vectors follows from Nau and McCardle's (1990) proof of existence of 
correlated equilibria. Due to the linearity of the conditions defining dual 
vectors and their refinements, any strictly convex combination of a full dual 
vector and of a strong dual vector is a dual vector which is both strong and 
full. This implies that there is at least one strong and full dual vector. It is 
actually easy to show that a dual vector is both strong and full if and only if 
it belongs to the relative interior of the (convex) set of dual vectors. 
The following lemma is a variant of Myerson's lemma 1: 

Lemma 3. Let i G N. Let a be a strong dual vector. Let a^i £ Xj-^jA(Cj). 
Assume that for every j ^ i, the mixed strategy aj is a j -stationary. For 
any pure strategy Ci of player i with marginal probability zero in all correlated 
equilibria, Ui{a^i,Ci) < Ui{a-i,ai *Cj). 

Proof. Let a = {cr^i,Ci). Since Cj has marginal probability zero in all cor- 
related equilibria, it follows that every strategy profile c with a{c) > has 
probability zero in all correlated equilibria. By definition of strong dual vec- 
tors, this implies that D(c,a) > 0. Therefore 

^cj(c)L>(c,a) > 

cec 

But since for every j ^ i, Uj is Oj-stationary, it follows that equation ([3]) is 
satisfied. Therefore 

< ^ cj(c)L>(c, a) = Ui{a-i,ai * cTj) - Ui{a) = Ui{a-i,ai * q) - Ui{a-i,Ci) 

(for the last equality, recall that (jj = Cj). The result follows. □ 

We now prove proposition [2 let a be a strong dual vector and a a Nash 
equilibrium of T/a, hence of T. By construction of T/a, for every j in N, aj 
is Oj-stationary. Therefore, by lemma [3l if q has marginal probability zero in 
all correlated equililibria, then q is not a best-response to U-j. So a satisfies 
the desired property. This completes the proof. 

A corollary of proposition [2] is that, if a game has a unique correlated 
equilibrium, then this correlated equilibrium is a quasi-strict Nash equilib- 
rium. This can also be shown directly as in (Viossat, 2007). 
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Tight games Consider the class of tight games, introduced by Nitzan (2005): 

Definition 4. A game is tight if in every correlated equilibrium fj,, all incen- 
tives constraints are tight: 

f,{c)[Ui{c-i,di)-U^{c)]=0 ^ieN,^c^(^C^,^d^eCi (5) 

Nitzan (2005) shows that, for any positive integer n, there is an open set 
of tight games within the set of n x n bimatrix games. 

Proposition 5. Any tight game has a completely mixed Nash equilibrium 

Proof. The definition of tight games may be rephrased as fohows: a game is 
tight if di jeopardizes q, for every player i and every couple of pure strategies 
{ci,di) in Ci X Ci. Therefore, if a is a full dual vector of a tight game T, then 
for every couple of pure strategies {ci,di) in Ci x Ci, we have ai{di\ci) > 0. 
Thus, for the Markov chain induced by Oi, there is a unique minimal absorbing 
set: the whole of Cj. Therefore, in the full dual reduction T/a, all strategies 
of player i are grouped together, and this for every i in N. It follows that T/a 
has a unique strategy profile a, which is a completely mixed strategy profile 
of T; furthermore, since a is trivially a Nash equilibrium of F/a, it is a Nash 
equilibrium of F. □ 

A class of games introduced by Nau et al (2004). Recall that Cf 
denotes the set of pure strategies of player i with positive marginal probability 
in at least one correlated equilibrium. Let us say that a game is pretight if, 
in every correlated equilibrium fi, every incentive constraint ([1]) with Cj and 
di in Cf is tight. That is, 

^ fiic)[U^ic.i,di)-U^{c)]=0 yieN,yci(£Cf,Wi£Cf (6) 

This condition, which is weaker than ([5]), has been introduced by Nau et al 
(2004). Recall that the inequalities defining the set of correlated equilibria 
are linear in /i, so that the set of correlated equilibria is a convex polytope. 
Nau et al (2004, proposition 2) showed that in any finite game, all Nash 
equilibria belong to the relative boundary of this polytope unless: (a) the game 
is pretight, and (b) there exists a Nash equilibrium with support XjgjyC'f. 
Dual reduction allows to show that (a) implies (b). 

Proposition 6. Any pretight game has a quasi-strict Nash equilibrium with 
support XjgTvC'f- 

The proof of proposition [6] uses results from section [H and so we postpone 
it to the appendix. Proposition[6]does not only show that Nau et al's condition 



9 



(a) implies their condition (b), but also that any pretight game has a quasi- 
strict Nash equilibrium: a nontrivial fact, since for n > 3, not all n-player 
games have a quasi-strict Nash equilibrium (van Damme, 1991). Moreover, 
from proposition [6l a converse of Nau et al's result may be obtained. Namely, 
if a game is pretight, then there is a Nash equilibrium in the relative interior 
of the correlated equilibrium polytope (Viossat, 2006). 

Dimension of the correlated equilibrium polytope. We now turn to 
another property of the correlated equilibrium polytope. It is well known that 
in generic 2x2 games, the correlated equilibrium polytope has dimension 
or 3, but not 1 nor 2. This might seem a peculiarity of 2 x 2 games, but dual 
reduction allows to show that in generic finite games, there are dimensions 
that the correlated equilibrium polytope cannot have: 

Proposition 7. In a generic finite game in which at least two players have 
at least two pure strategies, the correlated equilibrium polytope does not have 
dimension \C\ — 2^ 

We first need to show that, unless a pure strategy is dominated or equiv- 
alent to a mixed strategy, there is no dual reduction which simply consists in 
eliminating this strategy (the converse has been shown by Myerson). 

Lemma 8. Let Ci E Q; assume that there exists a dual vector a such that 
Ci ^ Ci/oi and Cj/aj = Cj for all j in N\{i}. Then there exists a mixed 
strategy ai in A(Cj) such that ai ^ Ci and Ui{c-i,ai) > Ui{c) for all c-i in 
C-i. 

Proof. Let = Oi * Ci. Since for all j ^ i, every pure strategy in Cj is 
aj-stationary, equation ([3]) yields: 

Ui{c-i,ai) >Ui{c) Vc^i e C^i 

Furthermore, Cj ^ Ci/ui hence is not CKj-stationary. Therefore Ci □ 

We now prove the proposition. For every i'm. N ^ and every couple of pure 
strategies {ci,di) in Ci x Ci, let 

:= Yl /i(c)[f/^(c-i,d,)-[/,(c)] =ol 

^Here is a more formal statement: let n > 2, let (mi, m^) S N" and assume that Yij^i ™j — 2 
for all i in {1, n}. Then within the set of mi x ... x m„ games, the set of games whose correlated 
equilibrium polytope has dimension mi x ... x m„ — 2 has Lebesgue measure 0. The restriction to 
games which are not essentially one-player games is needed, because in 2 x 1 games, the correlated 
equilibrium polytope has generically dimension = 2 — 2. 
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Thus, di jeopardizes Cj if and only if all correlated equilibria belong to H^^^di- 
Generically, either a player has a strictly dominated strategy (case 1) or 
the following properties are satisfied simultaneously (case 2): 

Gi^a^ 3c-i G C„i, Ui{c-i,ai) < Ui{c), Wi G iV, G Ci, VcJi G A{Ci) (7) 

Hc^A + + i, V(q, d,) Gdx Ci,yicj,dj) G Cj X Cj (8) 

so it suffices to examine these two cases. 

Case 1 : let q be strictly dominated. Then q has marginal probability zero 
in all correlated equilibria. The correlated equilibrium polytope may thus be 
seen as a subset of A(C') with C = {Ci\{ci}) x C-f, therefore, its dimension 
is at most {\Ci\ - 1) x |C_i| = \C\ - \C-i\ -l<\C\-2. 

Case 2: if the game is elementary, then the correlated equilibrium polytope 
has dimension |C| — 1 7^ |C| — 2. Otherwise, there exists a player i and a couple 
of pure strategies {ci,di), with q 7^ di, such that di jeopardizes q. That is, 
every correlated equilibrium is in Hc^^di- Therefore, by proposition [H there 
exists a dual vector a such that Cj ^ Ci/ui. Due to condition ([7]) and lemma 
[8l this implies that there exists j in A^\{i} and Cj in Cj such that Cj ^ Cj/aj. 
It follows that Cj is jeopardized by some strategy dj in Cj\{cj}. That is, 
every correlated equilibrium is in H^.. ^dj ■ Therefore the correlated equilibrium 
polytope is a subset of A(C) fl H(.- d^ H H^-^dj- It follows from ^ that -ffc^.d,; 
and H(,. dj are proper subsets of mI*""!, and from ([8|) that they are distinct. As 
an intersection of two distinct hyperplanes of m''^', -ffci,di H Hc^^dj is a vector 
space of dimension \C\ — 2. Its intersection with the simplex A(C) has at 
most dimension \C\ — 3 and it includes the correlated equilibrium polytope. 
Therefore, this polytope has at most dimension \C\ — 3. This completes the 
proof. 

4 Properties of dual reduction 

The examples of applications given in the previous section suggest, at least to 
us, that it might be worthwhile to study in greater depth the properties of dual 
reduction. This is the object of this section. Section 14.11 shows that, though 
positive affine transformations and other rescalings of the payoffs affect the 
set of dual vectors, they do not change the ways in which a game may be 
reduced. In section 14.21 we try to understand which kind of strategies are 
eliminated in dual reductions. We show for instance that strategies with zero 
probability in all correlated equilibria are eliminated in all full dual reductions, 
but that this is not true of weakly dominated strategies. Section 14.31 studies 
the properties of dual reduction in specific classes of games such as zero-sum 
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games or symmetric games. Finally, section 14.41 shows that, in almost all 2- 
player games, the process of iterative full dual reduction is uniquely defined. 

4.1 Payoff rescaling and dual reduction 

Let r and T' be two games with the same sets of players and strategies. Let 
U- denote the utility function of player i mT'. 

Definition 9. The game V is a rescaling of T if for every player i in N, 
there exists a positive constant Oj and a function fi : C-i M such that: 

Ul{c) = ai.Ui{c) + fi{c-i), VcGC 

If r' is a rescaling of T, then T and V represent essentially the same 
economic situation. So it is reassuring to note that they can be reduced in 
the same ways: 

Proposition 10. Let T' be a rescaling ofT. If a is a dual vector of T then 
there exists a dual vector a' ofT' such that T'/a' = T'/a. That is, T'/a is a 
dual reduction of T' . 

This result would be obvious if a game and its rescalings had the same 
dual vectors, but the following example shows that this is not the case. 

Example 11. 

X2 y2 X2 2/2 

xi 1,-1 -1,1 xi 2,-1 -2,1 

2/1 -1,1 1,-1 yi -2,1 2,-1 

Let T denote the game on the left (Matching Pennies) and T' its rescaling on 
the right. Define a by ai * Xi = Ui * yi = ^Xj + ^yi for every i in {1, 2}. Then 
a is a dual vector for T but not for T' . 

The key is that different vectors of deviation plans may induce the same 
reduced game. For instance, in example [TH define a' by a[*ci = ^(ci+ai*ci) 
for all ci in {xi,yi}, and 02 = ck2- It may be checked that a' is a dual vector of 
F' and that a and a' induce the same reduced game: T'/a' = T'/a. Therefore, 
even though a is not a dual vector of F', T'/a is a dual reduction of F. We 
now generalize this idea. 

Lemma 12. Let ai be a deviation plan for player i. Let < e < 1. Define 
the deviation plan a\ by a\ * Ci = e{ai * Ci) + {1 — e)ci. Then Ci/ai = Ci/a\. 

Proof. For any mixed strategy ai in A((7j), a- * cxj — cxj = e(aj * ai — ai). 
Therefore, Oj and a- induce the same stationary strategies □ 
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We can now prove proposition [TOl The proof consists in showing that dual 
vectors of F may be "rescaled" into dual vectors of T'. Let a be a dual vector 
of r. Let ttfc = minjgTv and, for each i in A'^, let = a^/ai (the constants 
are those of definition [9|) . Recall the definition of a • from lemma [12] and let 

a' = (a-' )ieAf • For every c in C, let D'{c, a') = ZlieAf t^i (^-«' * '^«) ~ f^i(c)]- 
A simple computation shows that 

L»'(c,a') = flfc X Z?(c,a) > Vc G C (9) 

where the inequality follows from the fact that a is a dual vector of F. There- 
fore a' is a dual vector of F'. But lemma [T2] implies that F'/a' = F'/a. This 
completes the proof. 

4.2 Which strategies and equihbria are eUminated? 

We say that the pure strategy Cj is eliminated in the dual reduction T/a 
if (Ti(cj) = for all cjj in Cj/aj. A pure strategy profile c is eliminated if 
(t(c) = for all a in C/a; that is, if for some i in N , Ci is eliminated. Finally, 
a correlated equilibrium /x is eliminated if there is no correlated strategy of 
T/a which induces ^ in F. In this section, we try to understand which kind 
of strategies and equilibria are eliminated in dual reductions. 

A first remark is that, as shown by Myerson, if a pure strategy is weakly 
dominated then there is a dual reduction which consists in eliminating this 
strategy. In that sense, dual reduction generalizes elimination of dominated 
strategies. However, this does not mean that weakly dominated strategies are 
eliminated in all non-trivial dual reductions, not even in full dual reductions: 

Example 13. 

xi 1,1 1,0 

yi 1,0 0,0 

In the above game, ^ is a correlated equilibrium if and only if y2 is not played 
in yU. That is, /u(xi,y2) = tJ'iyi,y2) = 0. Therefore xi and yi jeopardize 
each other. It follows that, in all full dual reductions, xi and yi are grouped 
together, hence yi is not eliminated. 

By contrast, in full dual reductions, strategies that have marginal proba- 
bility zero in all correlated equilibria are eliminated, and a similar result holds 
for strategy profiles. 

Proposition 14. Let c £ C (resp. Ci (z Ci) be a pure strategy profile (resp. 
pure strategy) with probability zero in all correlated equilibria. Then c (resp. 
Ci ) is eliminated in all full dual reductions and in all elementary iterative dual 
reductions. 
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Proof. First consider elementary iterative dual reductions: if F*^ is an ele- 
mentary iterative dual reduction of F, it has a correlated equilibrium with 
full support, which induces a correlated equilibrium of F. Therefore all pure 
strategy profiles (resp. pure strategies) of F that have not been eliminated in 
F^ have positive probability in some correlated equilibrium|§ 

Now consider full dual reductions. Let a be a dual vector. Let a € C/a. 
By definition of C/a, ai*(Ti = for all i in A^. Therefore, it follows from ([2]) 
that X^ceC ''^(^)-^('^' ~ 0- Since by definition of dual vectors, D{c,a) > 
for all c in C, this implies that 

D{c,a) > ^ o-(c) = 0. 

Assume now that a is strong and full, and let c be a pure strategy profile 
with probability zero in all correlated equilibria. Since a is a strong dual 
vector, we have D{c,a) > hence cr(c) = 0. Therefore, c is eliminated in 
the dual reduction F/a. But since a is a full dual vector and since in all full 
dual reductions, the same strategy profiles are eliminated, it follows that c is 
eliminated in all full dual reductions 

Finally, let Cj be a pure strategy profile with marginal probability zero 
in all correlated equilibria. For all C-i in C-i, c = (c_i,Ci) has probability 
zero in all correlated equilibria. Therefore, in a full dual reduction, (c_i,Ci) 
is eliminated for all c_j in C-i, whence Cj itself is eliminated. □ 

We now turn to equilibria. Let us say that in a dual reduction, a correlated 
equilibrium is eliminated if there is no correlated strategy of the reduced 
game which induces /z in the original game. 

Proposition 15. Strict correlated equilibria cannot be eliminated, not even 
in an iterative dual reduction. 

Proof. If ^ is a strict correlated equilibrium, a strategy that has positive 
marginal probability in /x cannot be jeopardized by another strategy. It follows 
that in any dual reduction of F, all pure strategies used in remain as pure 
strategies. Furthermore, as the player's options for deviating are more limited 
in the reduced game than in F, // is a fortiori a strict correlated equilibrium 
of the reduced game. Inductively, in any iterative dual reduction of F, all 
strategies used in fi are available and is still a strict correlated equilibriuml§ 

□ 



owe my understanding of this point to Roger Myerson. 
^Since all full dual reductions eliminate the same strategies, they also eliminate the same strat- 
egy profiles. 

®The proof shows that a pure strategy that has positive marginal probability in some strict 
correlated equilibrium can never be eliminated nor grouped with other strategies. This generalizes 
the fact that elementary games cannot be reduced. 
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By contrast, the following example shows that completely mixed Nash 
equilibria may be eliminated in all nontrivial dual reductions: 



X2 2/2 

yi 2,0 1,1 

zi 2,0 -1,-1 



Z2 

-1,-1 



1,1 



2/2 

yi 1,1 

zi -1,-1 



Z2 
-1,-1 



1,1 



In the left game, playing each strategy with equal probability is a completely 
mixed Nash equilibrium. However, the unique nontrivial dual reduction is the 
game on the right, in which X2 and thus all completely mixed Nash equilibria of 
the original game have been eliminated. (To see that the only nontrivial dual 
reduction consists in eliminating X2, note that, for player 2, X2 is equivalent to 
\y2 + \z2'^ this implies that y2 and Z2 jeopardize X2- Furthermore, for any i in 
{1, 2}, Di and Zi must be stationary under any dual vector because they have 
positive probability in a strict correlated equilibrium. The result follows.) 

In the above example, the reduced game is obtained by eliminating a pure 
strategy of player 2 which is redundant in the sense that it yields the same 
payoffs to player 2 as another (mixed) strategy. More generally, let F' = 
{A^, (Cj')igAr, (fj)jgAr} be a game built on F by omitting some pure strategies. 
Assume that the omitted strategies are redundant in the following sense: 



Vi G A^,Vc, G C,\Cl^a, G A(C;),Vc_, G C/i(c_„ c,) = Ui{c-i,ai) (10) 



Then F' is a dual reduction of F. (Indeed, for all i in A^, let ctj * Cj = Oi 
(defined in ([TO]) ) if Cj ^ C[ and *Ci = Cj otherwise; this defines a dual vector 
a such that F/a = F'.) In particular, dual reduction allows to reduce any 
game into its reduced normal form (Kohlberg and Mertens, 1986). 

We conclude this section by noting that the links between dual reduction, 
elimination of unacceptable strategies (Myerson, 1986) and perfect correlated 
equilibria (Dhillon and Mertens, 1996) are explored in (Viossat, 2005). 

4.3 Dual reduction in specific classes of games 
4.3.1 Two-player zero-sum games 

It is easy to show that any dual reduction of a zero-sum game is a zero-sum 
game with the same value. Furthermore, dual vectors may be built easily 
from optimal strategies: 

Proposition 16. Let F denote a two-player zero-sum game and a a profile 
of deviation plans. If for all i = 1,2 and for all Ci in Ci, the mixed strategy 
Ui * Ci is an optimal strategy, then a is a dual vector. 

Proof. Let c be a pure strategy profile. Since ai * ci is optimal, it follows that 
C/i(ai *ci, C2) > w, where V is the value of the game. Similarly, t/2(ci, a2*C2) > 
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—V. Therefore, * ci, C2) + C/2(ci, 02 * C2) > = Ui{c) + U2{c). Since this 

holds for all c in C, it follows that q is a dual vector. □ 

Corollary 17. For every Nash equilibrium a of a zero-sum game, there exists 
a dual reduction in which the reduced set of strategy profiles is the singleton 
{a}. 

Proof. In the particular case of proposition [16] where ai * Ci = ai for every 
player i and every Cj in Cj, the only ctj-stationary strategy is cij. Therefore, 
the reduced set Cijai of pure strategies of player i is the singleton {cjj}. □ 

Proposition 18. Consider a two-player zero-sum game. In all full dual re- 
ductions, for every player, all pure strategies with positive marginal probability 
in at least one correlated equilibrium are grouped together and all other pure 
strategies are eliminated. 

Proof. Let Cf denote the set of pure strategies of player i with positive prob- 
ability in at least one correlated equilibrium. Consider a full dual reduction. 
The fact that strategies in Ci\Cf are eliminated follows from proposition 
[T4l Furthermore, it follows from (Forges, 1990) that player i has an optimal 
strategy with support Cf . Due to propositions [16] and [H this implies that 
all strategies in Cf jeopardize each other. Therefore, in a full dual reduction, 
they are either all eliminated or all grouped together. The first case is ruled 
out because all other strategies are eliminated. This completes the proof. □ 

4.3.2 Games with a unique correlated equilibrium 

If r has a unique Nash equilibrium a, then any iterative dual reduction of 
r has a unique Nash equilibrium, which induces a in F; but the strategy 
space need not be reducible to a. In particular, it may be that a (nontrivial) 
game has a unique, pure Nash equilibrium but is nevertheless elementary, 
hence cannot be reduced. This is the case in example 4 of Nau and McCardle 
(1990). By contrast: 

Proposition 19. Assume that F has a unique correlated equilibrium a (note 
that a is then a Nash equilibrium, hence may be seen as a mixed strategy 
profile). In any full or elementary iterative dual reduction, the set of pure 
strategy profiles is reduced to {a}. In particular, F has a unique full dual 
reduction. 

Proof. The part of the proposition concerning elementary iterative dual re- 
ductions follows from our elementary proof of the fact that a unique correlated 
equilibrium is a Nash equilibrium (section [3]) . For full dual reductions, let Cf 
denote the set of pure strategies of player i with positive probability in at least 
one correlated equilibrium. Since there is a unique correlated equilibrium, 
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which is thus a Nash equihbrium, all strategies in Cf trivially jeopardize each 
other. Then apply the same argument as in the proof of proposition [TSl □ 

4.3.3 Games with symmetries 

Let r be a two-player symmetric game. That is, Ci = C2 = {1,2, ...,m} 
and for all {k,l) in {1, 2, m}^, Ui{k,l) = U2{l,k). If a = (ai,a2) is a 
dual vector, then so are a' = {a2,ai) and a = (q + a')/2. Moreover, F/a 
is symmetric. This section shows that, more generally, if a game has some 
symmetries (e.g. cyclic symmetry), then it may be reduced in a way which 
respect these symmetries. 

Let P be a set of permutations of the set of players. Let F be a game for 
which, for every i in N and every permutation p in P, player i and player p{i) 
have the same set of pure strategies. For every c in C and every permutation 
p in P, define the pure strategy profile by c^^^^ = q for every i in N. 

Definition 20. The game F is p-symmetric if, for all i in N, Up(^i-^{d') = 
Ui{c). It is P-symmetric if it is p-symmetric for every p in P. 

Proposition 21. IfT is P-symmetric then there exists a strong and full dual 
vector a such that T/a is P-symmetric. 

Proof. Without loss of generality, assume that P is the largest set of permu- 
tations such that F is P-symmetric. Note that for any permutations p and 
p, if F is both p- and p-symmetric then it is p o p-symmetric. Therefore, by 
maximality of P, 

Vp € P,{pop,p G P} = P (11) 

Let a be a strong and full dual vector. For every permutation p in P, define 
the dual vector by Opj-j) = on for every i in A^. Let 

_ EpGP «^ 

"^^^ 

Let p in P. Due to (jlip . = a, so that for every i in N, Q;p(j) = ctp^jj = Oj- It 
follows that for any i in N, Cp(^i-j/ap(^i-j = Ci/on and that T/a is p-symmetric. 
Therefore V/a is P-symmetric. Finally, since a is a strong and full dual 
vector, so is a. This concludes the proof. □ 

4.3.4 Generic 2x2 games 

Let F be a 2 X 2 game such that 

c' ^ Ui{c) Ui{c'), V(c,c') G C72,Vi G {1,2} 

It is well known that such a game is either elementary, in which case it cannot 
be reduced, or has a unique correlated equilibrium distribution, in which case 
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proposition [19] applies. The first case corresponds to coordination-like games, 
with three Nash equilibria: two pure and one completely mixed; the second 
case to games with either a dominating strategy or a unique, completely mixed 
Nash equilibrium. The games in Myerson's figures 3 and 5 are instances of 
the second case. 

4.4 Uniqueness of the reduction process 

Let r denote the rather trivial game: 

X2 2/2 

XX 1,1 0,1 

Let e s]0, 1[. Define the full dual vector a"" by a|*X2 = Oi\*V'^ — £^2 + (l — e)y2- 
In the full dual reduction L/cte, there is a unique pure strategy profile whose 
payoffs (e, 1) depend on e. Thus, even if only full dual reductions are used, 
there might still be multiple ways to reduce a game. Other examples (omitted) 
suggest however that multiplicity of full dual reductions typically arises when 
a player is indifferent between some of his strategies, or becomes so after 
elimination of strategies of the other players. Such indifference is a non- 
generic phenomenon and we show below that almost all two-player games 
have a unique sequence of iterative full dual reductions. We first show that 
there are severe restrictions on the ways strategies may be grouped together. 

Notation: for all i in N ^ let Bi C Ci and let B = Xi^j^Bi. We denote by 
r_B = (-^5 {Bi)ifzN, (C/j)jgAr) the game obtained from T by reducing the pure 
strategy set of player i to Bi, for all i in N. 

Proposition 22. Let a be a dual vector. For each i in N , let Bi C Ci denote 
a minimal Ui-ahsorhing set and B = 'Xnz^Bi. Let cjb, denote the unique Oi- 
stationary strategy of player i with support in Bi and as = {(yBi)i&N- We 
have: ctb is a completely mixed Nash equilibrium ofTs- 

Proof. The proof draws on the remark made by Myerson at the end of the 
proof of his lemma 2. Since Bi is aj-absorbing, we may define a'^ : Bi ^ ^{Bi) 
by a'j^ * Ci = Ui * Ci for all Cj in Bi. Since a is a dual vector of F, it follows 
that a' is a dual vector of F^. Moreover, B/a' = {ctb}, hence as is a 
Nash equilibrium of F^/a'. This implies that cjb is a Nash equilibrium of 
F^. Finally, by minimality of Bi, the support of as^ is exactly Bi so as is 
completely mixed. □ 

Corollary 23. Assume that for every product B = Xi^j^Bi of subsets Bi of 
Ci, Tb has at most one completely mixed Nash equilibrium. Then F has a 
unique full dual reduction. 
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Proof. Let a and a' be two full dual vectors. Let a € C/a. Let Bi denote the 
support of (jj (seen as an element of A(Ci)) and let B = Xi^i^Bi. Note that, 
as the support of an ctj-stationnary strategy, Bi is a minimal aj-absorbing set. 
Since full dual vectors have the same minimal absorbing sets, it follows that 
Bi is also a minimal a --absorbing set. Therefore, there exists r in C/a' such 
that Tj has support for all i m. N . By proposition 1221 both a and r are 
completely mixed Nash equilibria of F^. By assumption, this implies o" = r, 
hence a G C ja. Therefore C/a = C/a' . □ 

In the remainder of this section, T is a two-player game. Consider the 
following conditions (which are satisfied by almost all two-player games) : 

(a) for all Nash equilibria cr, the supports of ai and (T2 have the same 
number of elementjf] 

(b) any game obtained from F by deleting some pure strategies satisfies 

(a) 

(c) for any i in {1,2}, for any Bi C Cj, B^i C C_j and B'_^ C C_i, 
with \Bi\ = \B_i\ = \B'_^\ > 2 and B_i n B'_- = 0, we have: if a and a' 
are completely mixed Nash equilibria of Fb-xb.^ and Fg.xs' respectively, 
then (Tj 7^ (T^. That is, the same mixed strategy of player i cannot be the 
i-component of a completely mixed Nash equilibrium both in F^.x^.^ and in 

Proposition 24. If T satisfies condition (h), then F has a unique full dual 
reduction. 

Proof. It suffices to show that condition (b) implies the assumption of corol- 
lary [23l The proof is by contradiction. Assume that there exists B = 
Bi X B2 C Ci X C2 such that F^ has two distinct completely mixed Nash 
equilibria a and r. Without loss of generality, assume ai t\. There exists 
A in M such that a\ := Xai + (1 — A)ri is in A(Ci) but its support is a strict 
subset of the support of ai. Since F^ is a bimatrix game and a and r are 
completely mixed (in F^), it follows that (cr^, (T2) is a Nash equilibrium of F^. 
But so is a. Therefore, for at least one of these equilibria, the supports of 
the strategies of the players do not have the same number of elements, hence 
condition (b) is not satisfied. □ 

Proposition 25. If T satisfies conditions (h) and (c), then there are only 
three possibilities: 

1 T is elementary 

2 In all dual reductions of T, some strategies are eliminated, hut no strate- 
gies are grouped together. 

^Any game which is nondegenerate in the sense of von Stengel (2002, def. 2.6 and thm 2.10) 
satisfies this condition. 
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3 In any full dual reduction of T, the reduced strategy space C/a is a 
singleton. 

Proof. Assume that T is not elementary and let q be a nontrivial dual vector. 
Assume that some strategies of player 1 (for instance) are grouped together. 
That is, there exists a minimal ai-absorbing set Bi with at least two ele- 
ments. Let i?2 and B2 be minimal a2-absorbing sets. Let denote the 
ai-stationary strategy with support in Bi. Define cjbj and cj^^ similarly. By 
proposition [22} (ctbi,o"_B2) {^Bii^^b'^) Nash equilibria of rB^x_B2 

respectively. Due to conditions (b) and (c), this implies B2 = B'2. 
Therefore, there is a unique minimal a2-absorbing set: B2. That is, C^jd^ 
is a singleton. Moreover, due to condition (b), B\ and B2 have the same 
number of elements. Thus B^ has at least two elements. Therefore, by the 
above reasoning, Ci/ai is also a singleton and we are done. □ 

If r satisfies condition (b) , then any game obtained by deleting some pure 
strategies of V obviously satisfies condition (b). Therefore, proposition [25] 
implies that: 

Corollary 26. If T satisfies conditions (b) and (c), then so does any dual 
reduction of P. 

Putting proposition [21] and corollary [26] together, we get 

Theorem 27. // P satisfies conditions (h) and (c), then P has a unique 
sequence of iterative full dual reductions. 



A Proof of proposition [6 

Let P be pretight. Let a be a strong and full dual vector. Note that by 
definition of pretight games, for any i in A^, all strategies of jeopardize 
each other. Since a is full, this implies that in P/a there is a unique pure 
strategy profile {fi}, which is a Nash equilibrium of P with support XjgjyC'f 
(the argument is the same as in the proof of proposition llSp . Moreover, since 
a is strong, it follows from the proof of lemma [3] that any pure strategy in 
Ci\Cf is not a best-response to o"-,. Since has support Cf, this implies 
that a is quasi-strict. 
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